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Abstract 

This  analysis  of  XPatch  synthesized  SAR  images 
shows  promising  results  on  existence  of  persistent 
scatterers  and  their  measurement  in  XPatch  im¬ 
agery.  Preliminary  results  based  on  persistent  scat¬ 
terers  and  a  generic  vehicle  model  demonstrate  es¬ 
timation  of  vehicle  orientation  to  about  3  degrees, 
length  between  wheels  to  about  30  cm,  and  estimat¬ 
ing  number  of  wheels,  without  knowledge  of  vehi¬ 
cle  class  or  pose.  Planned  research  will  investigate 
recognition  using  generic  target  and  clutter  models 
in  analysis  of  a  stable,  useful  subset  of  radar  images. 
Research  will  include  quantitative  characterization 
of  persistent  scatterers  and  stable  relations,  an  end- 
to-end  recognition  test,  and  investigation  of  support¬ 
ing  technology  for  MSTAR.  The  paradigm  offers  a 
genuine  methodology  to  cope  with  articulation  and 
obscuration. 


1  Introduction 

SAR  imagery  is  known  to  vary  rapidly  with  tar¬ 
get  angle.  Scatterers  appear  and  disappear  over  a 
few  degrees.  The  resultant  image  variability  makes 
ATR  template  matching  computationally  complex, 
requiring  search  for  match  over  a  relatively  dense 
set  of  angles.  That  image  variability  also  lessens  the 
discrimination  power  of  template  matching  in  ATR, 
because  data  images  cannot  be  guaranteed  to  match 
exactly.  Matching  errors  tend  to  introduce  biases  in 
matching;  matching  algorithms  must  relax  matching 
constraints.  Existing  systems  work  reasonably  for 
unarticulated,  unobstructed  targets,  e.g.  MSTAR 
and  [Ikeuchi  96;  Novak  94;  Novak  95;  Novak  96]. 


However,  results  degrade  with  obscuration  and  ar¬ 
ticulation. 

Research  leading  to  this  project  was  intended  to  in¬ 
vestigate  whether  a  stable,  useful  subset  of  radar 
images  could  be  found,  i.e.  to  investigate  whether 
persistent  scatterers  exist,  enough  scatterers  suffi¬ 
ciently  persistent  that  indexing  could  be  done  ini¬ 
tially  with  persistent  scatterers,  to  characterize  their 
behavior  in  a  preliminary  way,  and  to  demonstrate 
that  scatterer  peaks  could  be  estimated  accurately 
to  represent  target  signals  in  MSTAR  or  in  an  in¬ 
tended  matching  algorithm. 

We  were  motivated  by  analysis  of  scattering  of  target 
components  to  ask  whether  stable  scatterers  exist. 
A  component  scattering  model  was  not  regarded  as 
plausible  in  1991.  In  turntable  experiments,  [Dud¬ 
geon  94]  found  evidence  for  persistent  scatterers,  a 
minimum  of  about  10  at  any  angle,  persistent  for 
a  minimum  of  20  degrees,  with  no  disappearance  of 
more  than  one  degree.  Subsequently,  we  found  per¬ 
sistent  scatterers  in  XPatch  data.  A  better  analytic 
understanding  was  since  derived  for  persistent  scat¬ 
terers  and  for  a  generic  component  scattering  model. 

An  analysis  based  on  partial  matching  of  persistent 
features  to  generic  vehicle  models  was  proposed  as  a 
solution  to  recognition  with  obscuration  and  articu¬ 
lation.  Generic  models  with  partial  matching  is  also 
a  methodology  for  hypothesis  generation  without  ex¬ 
haustive  enumeration  of  targets  and  poses.  Lessen¬ 
ing  variability  by  choosing  persistent  scatterers  and 
stable  relations  might  possibly  compensate  in  part 
for  the  loss  of  unavoidable  loss  of  discriminability 
with  obscuration  and  articulation. 


*This  research  was  supported  by  a  contract  from 
the  Air  Force,  F3361 5-93-1-1281  through  WPAFB  from 
ARPA  ASTO  “Multi- Sensor  ATR:  Quasi-Invariants  and 
High  Accuracy  Measurements  in  Bayesian  Inference” 
and  “Context  and  Quasi- Invariants  in  ATR  with  SAR 
Imagery” . 


The  objective  of  this  project  is  to  develop  target 
recognition  based  on  persistent  scatterers  and  stable 
relations  in  the  support  of  the  MSTAR  paradigm  for 
ATR  and  in  development  of  a  new  recognition  sys¬ 
tem.  The  following  subgoals  lie  along  the  path  to¬ 
ward  that  goal:  to  characterize  persistent  scatterers 
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further;  to  characterize  stable  relations  among  per¬ 
sistent  scatterers;  to  investigate  non-persistent  scat- 
terers  and  incorporate  matching  them  in  a  match¬ 
ing  scheme;  to  develop  a  generic  image  model  and 
generic  target  model;  to  derive  and  implement  a 
recognition  algorithm  in  a  Bayesian  network  [Bin- 
ford  ei.  al.  87],  based  on  generic  image  and  target 
models  to  estimate  angle  and  dimensions  of  vehicles 
without  enumerating  vehicle  class  and  pose. 

At  the  same  time,  context  is  widely  regarded  as 
an  effective  way  to  eliminate  large  classes  of  clut¬ 
ter  from  fixed  targets  and  civilian  vehicles  [Levitt 
95].  This  research  will  investigate  context-enhanced 
discrimination  of  targets  vs  natural  and  cultural 
clutter  based  on  correspondence  between  context 
from  available  databases  {e,g,  DMIF  or  HUB) 
and  extended  structures  registered  from  imagery 
[Oliver  90;  Posner  93;  Wellman  93}.  Progress  in 
using  context  will  come  from  improved  discrimina¬ 
tion  using  structures  found  from  texture  analysis 
and  from  buildings  discriminated  from  analysis  of 
leading  edges  in  their  radar  image. 


2  Toward  an  Effective  Methodology 

Some  questions  need  to  be  answered  concerning  ef¬ 
fectiveness  of  this  methodology.  1)  Is  there  a  use¬ 
ful,  stable  subset  of  a  SAR  image,  enough  persis¬ 
tent  scatterers  to  constrain  target  hypotheses,  suf¬ 
ficiently  persistent  to  implement  a  hierarchical  in¬ 
dexing  scheme  proposed  in  this  component-based, 
body-centered  recognition  paradigm?  2)  Are  there 
stable  relations  among  persistent  scatterers  that  en¬ 
able  partial  matching  that  is  computationally  afford¬ 
able?  Among  partial  matching  algorithms  are  both 
computationally  effective  and  computationally  ex¬ 
pensive  algorithms.  3)  Can  features  be  extracted 
from  persistent  scatterers  accurately  enough  over  a 
broad  range  of  target  orientations  with  enough  in¬ 
dependence  from  interference  among  scatterers  to 
enable  stable  estimation  of  scatterer  locations  and 
stable  estimation  of  relations  among  them  to  enable 
estimating  vehicle  orientation  and  dimensions  with¬ 
out  knowing  vehicle  class  or  orientation.  4)  Can  a 
generic  vehicle  model  be  formulated  that  gives  a  ba¬ 
sis  for  predicting  automatically  which  stable  rela¬ 
tions  will  exist  and  be  useful  in  a  broad  range  of 
images. 

We  show  preliminary  results  for  XPatch  data  for 
three  vehicles.  Using  synthesized  data  provides  data 
over  a  range  of  controlled  situations  essential  to  de¬ 
veloping  a  sound  algorithm  basis,  before  develop¬ 
ment  on  real  data.  Ikeuchi  at  CMU  provided  the 
XPatch  data.  In  Figure  1,  at  the  top  is  a  low  qual¬ 
ity  optical  image  of  a  BTR60.  Below  it  are  6  SAR 
images  from  XPatch  at  a  range  of  angles:  6,  12,  18 
degrees,  then  below,  30,  36,  42  degrees.  Note  that 
the  SAR  images  are  defo cussed  in  the  range  direc¬ 


tion;  presumably  they  could  be  focussed  better  by 
a  choice  of  XPatch  parameters.  At  the  bottom  are 
intensity  profiles  along  the  leading  edge  of  the  target 
at  angles  of  31,  37,  and  43  degrees  and  69,  75,  and  81 
degrees.  We  see  four  peaks  with  nearly  constant  am¬ 
plitude  (to  15%).  Note  that  the  peaks  persist  from  6 
degrees  to  174  degrees,  nearly  the  whole  target  angle 
range.  The  BTR60  has  four  wheels  with  wheel  spac¬ 
ing  consistent  with  the  good  measurements  available 
from  peak  detection.  Wheel  spacings  provide  a  geo¬ 
metric  invariant  (or  several)  and  several  geometric 
quasi-invariants.  Peak  amplitudes  provide  photo¬ 
metric  quasi- invariants  independent  of  photometric 
calibration  of  the  image. 

Figure  2  shows  evidence  of  persistent  scatterers  over 
the  whole  vehicle.  In  the  upper  left  are  peak  scatter¬ 
ers  for  the  BTR60,  extracted  by  our  peak  detection 
algorithms  from  XPatch  images  over  angles  from  45 
to  135  degrees.  Results  are  similar  over  nearly  0  to 
180  degrees.  Peaks  extracted  from  XPatch  images  at 
1  degree  intervals  for  constant  slant  angle  are  rotated 
to  zero  degrees  azimuth  and  superimposed.  We  see 
four  clear  clusters  on  the  leading  edge  and  eight  or 
nine  more  clusters  interior  on  the  vehicle,  along  the 
top.  On  the  middle  right,  the  four  peaks  were  iso¬ 
lated  using  their  statistical  distribution.  In  the  lower 
left,  the  four  peaks  are  shown  in  a  3D  plot  intended 
to  demonstrate  in  an  intuitive  and  semi-quantitative 
way  the  level  of  persistence  of  the  scatterers.  The 
plot  shows  (x,y)  position  as  a  function  of  azimuth 
angle  at  angles  from  45  to  135  degrees.  If  we  look 
along  the  vehicle  leading  edge  (x),  we  see  that  the 
peaks  are  well-separated,  with  few  dropouts. 

Existence  of  stable  relations  seem  to  be  born  out  by 
measurements  of  ratios  of  wheel  spacings  over  large 
ranges  of  angles.  There  is  also  strong  analytic  rea¬ 
soning  in  support  of  geometric  invariants  and  quasi¬ 
invariants.  Subsequent  detailed  SAR  image  analysis 
may  strengthen  and  refine  this  expectation.  Much 
more  analysis  will  be  made  of  similar  data  using 
XPatch  backtrace  facilities  to  determine  where  the 
true  scatterers  are,  to  quantify  variability  of  individ¬ 
ual  scatterers  for  incorporation  into  estimation  and 
decision  algorithms,  and  to  serve  as  ground  truth 
for  peak  estimation  and  feature  detection.  Non- 
persistent  scatterers  and  the  ratio  of  persistent  to 
non-persistent  will  be  studied.  These  investigations 
will  be  carried  out  in  collaboration  with  Vince  Velten 
from  Wright- Patterson  AFB  and  Dr.  Eamon  Barret 
and  Dr.  Paul  Payton  from  Lockheed-Martin. 

Figure  3  shows  preliminary  steps  in  target  recogni¬ 
tion.  In  the  upper  left  is  an  XPatch  image  of  the 
BTR60  at  45  degrees.  The  lower  left  shows  the 
Delaunay  triangulation  of  peaks  detected  from  the 
XPatch  image  in  the  target  cluster.  In  the  upper 
right  are  peaks  detected  in  the  image,  with  peaks  on 
the  longer  leading  edge  marked  with  a  surrounding 
circle;  peaks  on  the  shorter  leading  edge  are  marked 
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with  a  cross.  The  leading  edge  perpendicular  pair 
is  shown  by  solid  lines.  In  the  lower  right,  candi¬ 
date  peaks  along  the  leading  edge  were  selected  for 
intensity  from  the  generic  vehicle  model  to  generate 
candidates  for  wheels.  Estimated  leading  edge  orien¬ 
tation,  length,  width,  and  distances  between  wheels 
are  shown. 

We  are  developing  an  algorithm  for  estimating  lead¬ 
ing  edges  of  targets,  insensitive  to  points  not  on 
the  leading  edge.  This  is  a  problem  for  which 
least-squares  estimation  is  ill-suited.  Least  squares 
weights  most  heavily  points  that  are  furthest  away. 
A  non  least-squares  method  was  developed,  essen¬ 
tially  that  used  in  linking  in  the  Binford-Horn  edge 
operator.  That  operator  will  be  used  in  computing 
leading  edges  of  buildings  to  discriminate  buildings 
and  other  fixed  clutter  from  targets. 

Figure  4  shows  estimation  of  azimuth  angles  over  a 
broad  range  of  angles  in  XPatch  data  for  three  tar¬ 
gets,  BTR60,  KTANK,  and  BMP.  These  estimates 
cover  a  range  from  10  to  170  degrees;  above  we  saw 
that  the  range  could  be  extended  a  little  further, 
but  it  cannot  be  extended  below  about  5  degrees. 
[Dudgeon  94]  observed  that  zero  degrees  and  ninety 
degrees  were  special  views.  Those  views  showed  up 
in  our  experiments  and  for  physical  reasons,  in  our 
generic  vehicle  model. 

Over  this  wide  range  of  angles,  the  standard  devi¬ 
ations  for  vehicle  azimuth  angles  were  4.0,  2.3,  and 
3.7  degrees.  We  believe  that  the  measurement  will 
improve  because  we  are  still  developing  the  algo¬ 
rithm.  It  still  makes  mistakes  in  including  interior, 
non  leading  edge  points  that  bias  the  result.  Stan¬ 
dard  deviations  are  strongly  affected  by  these  mis¬ 
takes,  i.e.  wild  points. 

Figure  5  shows  persistence  for  KTANK  similar  to 
Figure  2  for  the  BTR60.  In  Figure  5,  top,  peaks 
from  views  at  1  degree  intervals  from  0  to  180  degrees 
were  rotated  into  the  0  degree  coordinate  frame  and 
superimposed.  At  the  bottom  are  peaks  from  the 
longer  leading  edge  Vive  peaks  appear  more  irreg¬ 
ular  than  in  the  BTR60  images.  Again,  the  peaks 
persist  over  nearly  the  whole  angle  range. 

Similar  results  were  obtained  for  the  BMP.  They  are 
omitted  to  cut  space  and  to  avoid  detail. 


3  Observations 

Persistent  scatterers  have  been  demonstrated  in  real 
SAR  from  turntable  data  [Dudgeon  94],  in  XPatch 
synthesized  SAR,  and  predicted  in  analysis.  At 
this  early  stage,  the  apparent  ratio  of  persistent  to 
non-persistent  scatterers  is  more  favorable  than  ex¬ 
pected.  There  appear  to  be  about  a  dozen  persis¬ 
tent  scatterers  on  vehicles  like  the  three  shown  here. 


Their  persistence  appears  over  a  broader  range  of 
angles  than  initially  expected  but  now  appears  to 
follow  from  good  reasons. 

Are  there  enough  scatterers?  There  appear  to  be 
about  12  persistent  scatterers  typical  for  these  tar¬ 
gets.  If  only  30%  of  them  were  obscured,  the  remain¬ 
der  seem  sufficient.  In  SAR,  two  scatterers  along  the 
leading  edge  provides  a  measured  constraint;  three 
scatterers  are  over-constrained.  Relative  to  a  lead¬ 
ing  edge  estimate,  an  additional  point  off  the  leading 
edge  is  another  constraint  on  matching.  With  only 
three  points,  there  are  two  constraints. 

A  next  step  is  incorporating  points  interior  to  the 
leading  edge,  again  exploiting  the  generic  model. 
Some  of  that  can  still  be  done  at  a  generic  level  for 
vehicles. 

One  foot  resolution  appears  to  be  a  magic  resolution 
at  which  useful  detail  becomes  apparent  for  vehicles 
the  size  of  the  military  vehicles  used  in  these  XPatch 
studies,  about  8  meters,  27  feet.  Although  many 
pixels  cover  these  vehicles’  images,  it  is  the  size  of 
scatterers  that  matters  here.  There  are  few  pixels 
on  wheels,  turrets,  and  other  observable  structures. 
Our  estimation  methods  seem  to  be  on  the  border¬ 
line  of  resolving  the  wheels  on  the  vehicles.  Making 
effective  use  of  available  image  resolution  is  extemely 
important. 

It  seems  that  improvements  in  the  peak  detection 
provides  strong  leverage  for  the  problem.  I.e.  re¬ 
solving  the  wheels  in  all  cases  on  the  leading  edge 
would  contribute  substantially  to  classifying  vehi¬ 
cles.  The  current  peak  detection  was  conceived  for 
isolated  peaks;  it  appears  very  useful  in  terrain  and 
vegetation.  On  targets,  peaks  overlap,  affecting  peak 
detection.  Rather  than  implement  our  understand¬ 
ing  of  a  solution  to  the  overlapping  peak  roblem, 
we  have  chosen  thus  far  to  push  on  to  a  broader, 
birds-eye  view  of  the  issues.  We  are  considering  im¬ 
provements  in  image  and  in  feature  detection  in  the 
raw  SAR  phase  history  data  before  image  formation 
or  exploiting  those  advances  of  others  in  superreso¬ 
lution  [Cabrera  94;  Mann  92;  Odendaal  94]. 

In  fact,  measurement  of  dimensions  seems  to  be  rel¬ 
atively  accurate.  The  distance  between  wheels  has 
a  standard  deviation  of  10  inches.  These  dimensions 
go  a  long  way  toward  constraining  vehicle  class. 


4  Conclusions 

These  preliminary  results  appear  to  warrant  fur¬ 
ther  investigation.  Persistent  scatterers  have  been 
demonstrated  in  real  and  synthesized  SAR  experi¬ 
ments;  they  are  expected  to  exist  for  good  reasons. 
At  this  early  stage,  persistence  appears  over  nearly 
the  whole  angle  range,  again  for  good  reasons.  A  suf- 
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ficient  number  of  persistent  scatterers  appear  that 
it  seems  promising  to  recognition.  Peak  detection 
seems  adequate  for  initial  investigation,  further  ac¬ 
curacy  refinement  may  be  necessary  to  exploit  avail¬ 
able  imagery.  A  generic  vehicle  model  has  proved 
surprisingly  powerful. 


5  References 

[Benitz  94]  G.R.Benitz,  ^^Adaptive  High- Definition 
Imaging”;  SPIE  Yol  2230,  pp  106-119,  1994. 
[Binford  87]  T.O.Binford,  ei.  al.^  “Bayesian  Infer¬ 
ence  in  Model-Based  Machine  Vision”;  Proc  Work¬ 
shop  on  Uncertainty  in  AI,  AAAI87,  1987. 

[Cabrera  94]  S.D. Cabrera,  et.  al.^  “Application 
of  One-Dimensional  Adaptive  Extrapolation  to  Im¬ 
prove  Resolution  in  Range-Doppler  Imaging”;  SPIE 
Vol  2230,  pp  135-145,  1994. 

[Dudgeon  94]  D.E. Dudgeon,  ei.  al.^  “Use  of  persis¬ 
tent  scatterers  for  model-based  recognition”;  SPIE 
Vol  2230,  pp  356-368,  1994. 

[Haag  91]  N.N.Haag,  ei.  aly  “Invariant  Relation¬ 
ships  in  Side-Looking  Synthetic  Aperture  Imagery” ; 
Phoigrammeiric  Engineering  and  Remote  Sensing^ 
V57  pp  927-931,  1991. 

[Ikeuchi  96]  K.Ikeuchi,  ei.  a!.,  “Invariant  Histograms 
and  Deformable  Template  Matching  for  SAR  Target 
Recognition”;  Proc  IEEE  CVPR^  pp  100-105,  1996. 
[Jane  84]  Foss,  Christopher  F.  “Janets  Light  Tanks 
and  Armoured  Cars”;  1984. 

[Levitt  95]  Levitt,  T.S.,  ei.  a/.,” Bayesian  Inference- 
Based  Fiision  of  Radar  Imagery,  Military  Forces  and 
Tactical  Terrain  Models  in  the  Image  Exploitation 
System/Balanced  Technology  Initiative”,  Inti.  J.  of 
Human- Computer  Studies^  No.  42,  1995. 

[Mann  92]  J.Mann  and  R.Hummel,  “Synthetic  Aper¬ 
ture  Radar  without  Fourier  Transforms”;  Courant 
Institute,  1992. 

[Moulin  93]  P. Moulin,  “A  Wavelet  Regulariza¬ 
tion  Method  for  Diffuse  Radar-Target  Imaging  and 
Speckle-Noise  Reduction”;  Journal  of  Maikematical 
Imaging  and  Vision^  3,  123-134,  1993. 

[Novak  94]  L.M. Novak  and  G.J.Owirka,  “Radar  Tar¬ 
get  Identification  Using  an  Eigen-Image  Approach”; 
IEEE  National  Radar  Conference,  Atlanta,  GA, 
1994. 

[Novak  95]  L.M. Novak,  ei.  ai,  “Effects  of  Polar¬ 
ization  and  Resolution  on  the  Performance  of  a 
SAR  Automatic  Target  Recognition  System”;  Lin¬ 
coln  Laboraiory  Journal,  Vol  8,  pp  49-68,  1995. 
[Novak  96]  L.M. Novak,  ei.  al.,  “ATR  Performance 
Using  Enhanced  Resolution  ATR”;  SPIE  Conf  on 
Algoriihms  for  Synikeiic  Aperture  Radar  Imagery 
III,  1996. 

[Odendaal  94]  J.W.Odendaal,  ei.  ai,  “Two- 
Dimensional  Super  resoltuion  Radar  Using  the  MU¬ 
SIC  Algorithm”;  IEEE  Transactions  on  Antennas 
and  Propagation,  V  42,  pp  1386-1391,  1994. 

[Oliver  90]  C.J. Oliver,  “Clutter  Classification  based 
on  a  correlated  noise  model”;  Inverse  Problems,  6, 


PP  77-89,  1990. 

[Owirka  94]  G.J.Owirka  and  L.M. Novak,  “A  New 
SAR  ATR  Algorithm  Suite”;  Conf  on  Algorithms 
for  Synthetic  Aperture  Radar,  1994. 

[Posner  93]  F.L. Posner,  “Texture  and  Speckle  in 
High  Resolution  Synthetic  Aperture  Radar  Clutter” ; 
IEEE  Trans  on  Geoscience  and  Remote  Sensing,  V 
31,  pp  192-203,  1993. 

[Wang  96]  B.  Wang  and  T.O.  Binford,  ” Generic, 
Model-based  Estimation  and  Detection  of  Peaks  in 
Image  Surfaces”,  Proceedings  of  Image  Understand¬ 
ing  Workshop,  Vol.  2,  pp. 913-922,  Feb.  1996. 
[Wellman93]  R.  J.  Wellman,  et.  al,  “Radar  Cross 
Sections  of  Ground  Clutter  at  95  GHz  for  Sum¬ 
mer  and  Fall  Conditions”;  AGARD  meeting  on  At¬ 
mospheric  Propagation  Effects  through  Natural  and 
Man-Made  Obscurants  for  Visible  to  MM-Wae  Ra¬ 
diation,  1993. 


4 


